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We compare weighted sums of i.i.d. positive random variables according to the usual stochas- 
tic order. The main inequalities are derived using majorization techniques under certain log- 
concavity assumptions. Specifically, let Yi be i.i.d. random variables on R+. Assuming that 
log Yi has a log-concave density, we show that ^aiYi is stochastically smaller than yj&jYi, if 
(logai, . . . ,loga n ) is majorized by (logfei, . . . ,log&„). On the other hand, assuming that Y? has 
a log-concave density for some p > 1, we show that YJajYi is stochastically larger than J^&jYi, 
if (a\, . . . , a%) is majorized by (p\ , . . . , b%), where p" 1 + q^ 1 = 1. These unify several stochastic 
ordering results for specific distributions. In particular, a conjecture of Hitczenko [Sankhya A 60 
(1998) 171-175] on Weibull variables is proved. Potential applications in reliability and wireless 
communications are mentioned. 
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1. Main results and examples 

This paper aims to unify and generalize certain stochastic comparison results concerning 
weighted sums. Let Yi,...,Y n be i.i.d. random variables on R + . We are interested in 
comparing two weighted sums, X)"=i a iY an d Yl7—i ^iYi at, &, G R+, with respect to the 
usual stochastic order. A random variable X is said to be no larger than Y in the usual 
stochastic order, written as X < st Y, if Pr(A > t) < Pr(Y~ > t) for all f e R. For an 
introduction to various stochastic orders, see [19]. Ordering in terms of < st may be used 
to bound the tail probability of J2 a iY, for example, in terms of the tail probability of 
^2 Yi. For specific distributions, such comparisons have been explored in several contexts, 
including reliability [2, 3]. 

We shall use the notion of majorization [15]. A real vector b = (pi,..., b n ) is said to 
majorize a = (ai, . . . , a n ), written as a -< b, if (i) Ym=i a i = S™=i &«j an d (ii) S"=fc a (i) - 
Sr=fe fyi), k = 2, . . . , n, where an\ < ■ ■ ■ < at n \ and bn\ < ■ ■ ■ < 6(„) are (oi, . . . , a n ) and 
(pi, . . . , b n ) arranged in increasing order, respectively. A function 4>(a) symmetric in the 
coordinates of a = (a\, . . . ,a n ) is said to be Schur-concave if a -< b implies <fi(a) > 0(6). 
A function 0(a) is Schur-convex if —0(a) is Schur-concave. 
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A non-negative function f(x),x £ R n , is log-concave if supp(/) is convex and log f{x) 
is concave on supp(/). Log-concavity plays a critical role in deriving our main results. 
For other stochastic comparison results involving log-concavity, see, for example, [10, 22, 
24, 25]. 

In this section, after stating our main results (Theorems 1 and 2), we illustrate with 
several examples and mention potential applications. The main results are proved in 
Section 2. Some technical details in the proof of Theorem 2 are collected in the Appendix. 

Theorem 1. Let Yy, . . . ,Y„ be i.i.d. random variables with density f{y) on R + such that 
f(e x ) is log-concave iniER. Then, for each t > 0,Pr(^ a^Yi < t) is a Schur-concave 
function of 

loga = (logai,...,loga„). 

Equivalently, z/a,&£R", then 

loga^logfc ^2a,iYi< st ^2biYi. (1.1) 

Theorem 2. Let p > 1, and let Yx,...,Y n be i.i.d. random variables with density f{y) 
on R + such that the function 

min{0,2/p- l}loga; + log/(a; 1/p ) (1.2) 

is concave in x 6 R+. Then, for each t > 0,Pr(^ a^Yi < t) is a Schur- convex function of 

a« = (a?,...,a*)eB.+> 
where p^ 1 + q^ 1 = 1. Equivalently, if a,b € R™ , then 

a^b q =^ J2 biYi ^J2 aiYi - ( L3 ) 

Remark. In Theorem 1, the condition that f(e x ) is log-concave is equivalent to logl^ 
having a log-concave density (see, e.g., [18]). In Theorem 2, a sufficient condition for (1.2) 
is that x x l v ~ x f(x x l v ) is log-concave, or, equivalently, Yf has a log-concave density (this 
special case is mentioned in the abstract). Theorems 1 and 2 are quite applicable, since 
log-concavity is associated with many well-known densities (see Corollaries 1 and 2). 

Theorem 1 is reminiscent of the following result of [17], originally stated in terms of 
the peakedness order. 

Theorem 3. Let Yi,i = 1, . . . , n, be i.i.d. random variables on R with a log-concave 
density that is symmetric about zero. Then for each t > 0, Pr(J^ et^Y; < t) is a Schur- 
concave function of a G R™ . 

Theorem 2 is closely related to Theorem 4, which is a version (with a stronger assump- 
tion) of Theorem 24 of [11]. 
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Theorem 4. Let < p < 1, and let Yi, . . . , Y„ fee i.i.d. random variables on R + such that 
Yf has a log-concave density. Then, for each t > 0,Pr(J^ a^Y <t) is a Schur-concave 
function of (a\, . . ., a*) 6 R" , where p^ 1 + q~ x = 1. 

Karlin and Rinott [11] gave an elegant proof of Theorem 4 using the Prekopa-Leindlcr 
inequality. Our proofs of Theorems 1 and 2 (Section 2) borrow ideas from both [17] 
and [11]. See [20] for more related inequalities. 

Bounds on the distribution function of ^2 a «Y are readily obtained in terms of the 
distribution function of Y. In Theorem 1, for example, (1.1) gives 

Pr(j2hYi<tj <PT(b*J2Yi<t)> fo* = (n^) 1/? V>0. (1-4) 
In Theorem 2, (1.3) gives 

Pr(j2hYi<t) >Pr (b*J2 *i<*), b* = (n' 1 ^ bfj ,t > 0. (1.5) 

More generally, we obtain inequalities for the expectations of monotone functions, since 
X <st Y implies Eg{X) < Eg(Y) for every increasing function g such that the expecta- 
tions exist. 

Let us mention some specific distributions to which Theorems 1 and 2 can be applied. 
Corollary 1 follows from Theorem 1. The log-concavity condition is easily verified in 
each case (for more distributions that satisfy this condition, see [8], Example 1). Related 
results on sums of uniform variables can be found in [13]. The gamma case has recently 
been discussed by Khaledi and Kochar [12], Yu [23] and Zhao and Balakrishnan [26]. 

Corollary 1. For a,&GR™, (1-1) holds when Yi are i.i.d. having one of the following 
distributions: 

(1) uniform on the interval (0, s),s>0; 

(2) gamma(a, ft), a, /3 > 0; 

(3) any log-normal distribution; 

(4) the Weibull distribution with parameter p > , whose density is 

f(y)=py p - 1 e~y p , y>Q; 

(5) the generalized Rayleigh distribution with parameter v > 0, whose density is 

f{y)^y v - 1 e-y 2 ' 2 , y>0. 

The inequality (1.4) holds for each of these distributions. The gamma case is interesting 
in that the upper bound in (1.4) is in terms of a single gamma variable, ^ Y. The gamma 
case with a = 1/2 dates back to [16]. See also [1, 21] for related inequalities. 

Corollary 2. Letp>l, and define q by p^ 1 + q^ 1 = 1. Then, for a,b G R™ , (1.3) holds 
in the following cases: 
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(1) Yi are i.i.d. Weibull variables with parameter p; 

(2) p = q = 2, and Yi are i.i.d. generalized Rayleigh variables with parameter v>l. 

Corollary 2 follows from Theorem 2. The condition (1.2) is easily verified. For example, 
in case 1, Yf has a log-concave density, which implies (1.2). Case 1 confirms a conjecture 
of [5]. Case 2 recovers some results of [6, 7]. 

The Weibull case and the generalized Rayleigh case are interesting in that Corollary 1 
is also applicable, and we obtain a double bound through (1.4) and (1.5). For example, 
if Yi are i.i.d. generalized Rayleigh variables with parameter v>l, then 

PT ( a *^2 Y i <t) <P^(y2aiYi<t\ <Pr(*a*^Fi <tj, a t >0,t>0, 

where a* = {n^^aj) 1 / 2 and a* = dl *) 1 ^™- Manesh and Khaledi [14] present related 
inequalities. 

We briefly mention some applications: 

• Weighted sums of independent \ 2 variables arise naturally in multivariate statis- 
tics as quadratic forms in normal variables. Stochastic comparisons between such 
weighted sums are therefore statistically interesting, and can lead to bounds on the 
distribution functions. 

• Suppose the component lifetimes of a redundant standby system (without repair- 
ing) arc modeled by a scale family of distributions. Then the total lifetime is of 
the form Yli a i^i- When Yi are i.i.d. exponential variables, Bon and Paltanea [3] 
obtain comparisons of the total lifetime with respect to several stochastic orders. 
Our Corollary 1 shows that, for the usual stochastic order, (1.1) actually holds for 
a broad class of distributions, including the commonly used gamma, Weibull, and 
log-normal distributions. 

• When Yi are i.i.d. exponential variables and ai G R+, the quantity £71og(l + X) a i^) 
appears in certain wireless communications problems [9]. By the monotonicity of 
log(l + x), we have 

^aiYi^^biYi Elog(l + J2ain) < £log(l + ^6^). 

Corollary 1 therefore leads to qualitative comparisons for this expected value. Other 
weighted sums (e.g., of Rayleigh variables) also appear in the context of communi- 
cations. 

It would be interesting to see whether results similar to Theorems 1, 2 and 4 can 
be obtained for the hazard rate order, or the likelihood ratio order. For sums of in- 
dependent gamma variables, such results have been obtained by Boland, El-Ncweihi 
and Proschan [2], Bon and Paltanea [3], Korwar [13], Khaledi and Kochar (2004) [12], 
Yu (2009) [23] and Zhao and Balakrishnan (2009) [26]. 
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Two proofs are presented for Theorem 1. The first one uses the Prckopa-Leindler in- 
equality (Lemma 1) and is inspired by Karlin and Rinott [11]. 

Lemma 1. If g(x,y) is log-concave in (x,y) £ R m x R™, then f Rm g(x,y) dx is log- 
concave in y G R" . 

We also use a basic criterion for Schur-concavity. 

Proposition 1. If h(a), a € R ' . is log-concave and permutation invariant in a, then it 
is Schur- concave. 

First proof of Theorem 1. For t > 0, define 

n ( n \ 

g(x, a) ee l K J] e x *f(e x >), K = \ (x, a) € R 2 '" : £ e** +a * < t , 
i=i I t=i J 

where x = (xi, . . . ,x n ), a = (ax, . . . , a n ) 6 R" . Note that if is a convex set (Ik denotes 
the indicator function). Since f(e Xi ) is log-concave, we know that g(x,a) is log-concave 
in (x,a). By Lemma 1, 

h(a)=Pr(^2e ai Yi<tj = ( g(x,a)dx 

is log-concave in a 6 R". Since h(pt) is permutation invariant, it is Schur-concave in a 
by Proposition 1, and the claim is proved. □ 

The second proof is inspired by Proschan [17], and serves as an introduction to the 
proof of Theorem 2. Properties of majorization imply that it suffices to prove (1.1) for 
a -< b such that a and b differ only in two components. Since < s t is closed under convolu- 
tion [19], we only need to prove (1.1) for n = 2. 

We shall use log-concavity in the following form. If g(x),x £ R, is log-concave, and 
(xi,x 2 ) -< (2/1,2/2), then 

g(xi)g(x 2 ) -5(^1)5(2/2) > 0. 

Second proof of Theorem 1. Fix t > 0, and let F denote the distribution function 
of Y\ . It suffices to show that 

/>oo 

h{fi) = PrfjS- 1 ^ +(3Y 2 <t)= F(tf3 - f3 2 y)f(y) dy 

Jo 

increases in fj e (0, 1]. We may assume that supp(/) C [e, 00) for some e > 0. The general 
case follows by a standard limiting argument. We can then justify differentiation under 
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the integral sign and obtain 

/>oo 

h'(P) = (t-2Py)f(t/3~/3 2 y)f(y)dy 



(2-1) 

,t/(2/3) r t//3 

= (t- 2py)f(tp - P 2 y)f(y) dy + (t - 2py)f(tp - P 2 y)f(y) Ay. 

JO Jt/(2{S) 

By a change of variables y — > t/ /3 — y m the second integral in (2.1), we get 

,t/(2/3) 

= / (* - 2/?y)[/(^ - P 2 y)f{y) - f(P 2 y)f(t/p - y)} dy. 



If < y < t/(2/3) and < /3 < 1, then < min{y,^ - ^ 2 y}. That is, 

(log(t/3 - A), logy) -< (log(/3 2 2/ ), log(t//? - j/)). 
Since f(e x ) is log-concave, we have 

f(tp - /3 2 y)/(y) - f(P 2 y)f(t/P -y)>0, 0<y< t/(2p), 
which leads to h'(/3) > 0, as required. □ 

Our proof of Theorem 2 is similar to (but more involved than) the second proof of 
Theorem 1. Under the stronger assumption that Yf has a log-concave density, we actually 
obtain a simpler proof of Theorem 2 following the first proof of Theorem 1 (sec [11]). It 
seems difficult, however, to extend this argument assuming only that (1.2) is concave. 

Proof of Theorem 2. We may assume n = 2 as in the second proof of Theorem 1. Fix 
t > 0. Effectively, we need to show that 



h((3) ee Pr^ 1 /^ + (1 - pfliYi <t)= F(tf3- 1/q - {P~ l - l) 1/q y)f(y) dy 

Jo 

increases in (3 £ [1/2, 1) (F denotes the distribution function of Y±). We have 

r°° pyo ryi 

q(l-P) 1 '*P 1 '*+ 1 h'(p)= g(y)dy= g(y)dy+ g(y)dy, 



where 

y =t(l-/3) 1/p , 2/i=t(l-/3)- 1/9 (2.2) 

and 

g(y) = (y-yo)f(x(y))f(y), x( y ) = {p~ l - \) 1 ^{ Vl - y ). (2.3) 



1050 



Y. Yu 



Differentiation under the integral sign is permitted because 

\g{y)\<(yi-yo)Mf( y ), 0<y<yi, 

where M = swp y>0 f(y). We know M < oo because (1.2) implies that f(x 1 / p ) is log- 
concave in x G R+ . 

In the Appendix, we prove: 

Claim 1. For each y G (0,?/o); there exists a unique y G (ycbyi) such that 

yP + x"(y) = yP + xP(y) 1 (2.4) 

where x(y) is given by (2.3). 

Henceforth let y and y be related by (2.4). Direct calculation using the implicit function 
theorem gives 

dy ^ (.Pv) p ' q -{{1-P){yi-V)) p ' q 
Ay G8y)*/« SO)*/'' 

A change of variables y — > y in g(y) dy yields 



dy 
dy 



dy 



in 



g(z)dz, 



i/n 



where A C (2/cb2/i) is the image of the interval (0,yo) under the mapping y — > y. Note 
that g(z) > for y < z < y\. Hence 



q (l - fSf/'p/^h'tf) > J (g{y) + g(y) 



dy 

dy 



dy 



> / (y-yo) 



f(?(v))m 



x(y)y 
x(y)y 



(2.5) 



f{<y))f{y) 



dy, 



where S = min{0,2 — p}. The inequality (2.5) is deduced from Claim 2, which we prove 
in the Appendix. 



Claim 2. We have 



dy 

dy 



> 



x(y)y\ 5 ( yo-y 



Mv)yJ \y-yo 

In the Appendix we also show: 

Claim 3. For < y < yo, we have 

py>(l-p)(yi-y); 
0V<O--P)(vi-V)- 



0<y<yo- 



(2.6) 



(2.7) 
(2.8) 
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For < y < y , (2.8) yields y < min{y, y x - y}, that is, 

(y,m -£H (y,yi -y)- 

Thus, y(yi — y) < y{yi — y), or, cquivalently, y p x p (y) < y p x p (y). By (2.4), this implies 
the relation 

(y p ,x p (y))^(y p ,x p (y)), 0<y<y . 
Assumption (1.2) then yields (S = min{0, 2 — p}) 

(x(y)y) s f(x(y))f(y) - (x(y)y) 5 f(x(y))f(y) > 0, y e A. 

It follows that the integrand in (2.5) is non-negative, and h'(0) > 0,f3 G [1/2,1), as re- 
quired. □ 

Remark 1 . The main complication in the proof of Theorem 2 is that the mapping y — > y 
is not in closed form. In the special case p = q = 2, where y is explicitly available, the 
proof can be simpler. 

Appendix: Proofs of Claims 1—3 

It is convenient to prove Claims 1, 3 and 2 in that order. We emphasize that no circular 
argument is involved. 

Proof of Claim 1. Define 

L( y )=/^V + (l-/3) p/9 (yi-2/) p , 0<y<y 1; (A.l) 
where y\ is given by (2.2). We have 

L' (y) - P/ 8* V" 1 - P(l - PY' q (Vi ~ y) P ~\ 
and the unique solution of L'(y) = is yo = til — /J) 1 ^. Moreover, 

£"(») =p(p - iW /q y p - 2 + (i - /?) p/9 (yi - y) p - 2 ] > o. 

Hence L(y) strictly decreases on the interval (0, yo) and strictly increases on (yo,yi)- We 
have L(0) < L(yi) because (3 G [1/2, 1). By continuity, for any < y < yo there exists 
a unique y G (yo,yi) that satisfies 

L(y)=L(y), 

which reduces to (2.4) after routine algebra. □ 

Proof of Claim 3. We only prove (2.7); the proof of (2.8) is similar. For < y < yo, 
define 

D(y) = L((p- 1 -l)(yi-y))-L(y). 
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Direct calculation using (A.l) gives 

D(y) = (1 - 0y/«[( yi - ip~ 1 - l)( yi - y)f 

- (/r 1 - i)((i - Pr'PvY (2 - r'Kvi - y) p ] 

<o, 

where the inequality follows from Jensen's inequality 

(au + (1 - a)v) p < au p + (1 - a)v p , p>l, 

with 

fl-i 1 ^ 

a = p -l, u = v = y^-y- 

That is, 

i((/3- 1 -i)(yi-y))<i(?/) = i(y), o<y< yo . (A.2) 

By the strict monotonicity of £,(■) on the interval (yo,yi), if — l)(z/i ~y)>Vi then 
— — 2/)) > L{y), which contradicts (A.2). Hence 

(p- 1 -i){vi-y)<y, 

as required. □ 

To prove Claim 2, we use Proposition 2. Define 

( u a -v a 

Q a (u,v) = \-^T> u,v>0 > u^v > 
{an 01 - 1 , u = v>0. 

Proposition 2. If < a < 1, then Q a (u,v) decreases in each of u, V > 0; if a>\, then 
Q a (u,v) increases in each ofu,v> 0. 

Proposition 2 follows from basic properties of the generalized logarithmic mean ([4], 
pages 386-387). 

Proof of Claim 2. For < y < yo, define 

u = Py, v = -y), u = py, v = (1 - f})(y x - y). 

Claim 3 says that v < u and u < v. Applying Proposition 2, we obtain 

Qp/ q (u,v)>Q p/q (v,u), l<p<2, (A. 3) 

and 

Qp/qiu^^-^^Qp/gii,- 1 ^- 1 ), P >2. (A.4) 

After routine algebra, (A.3) (for 1 < p < 2) and (A.4) (for p > 2) reduce to (2.6). □ 
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